WePS3 Evaluation Campaign: Overview of the On-line Reputation Management Task
نویسندگان
چکیده
This paper summarizes the definition, resources, evaluation methodology and metrics, participation and comparative results for the second task of the WEPS-3 evaluation campaign. The so-called OnlineReputation Management task consists of filtering Twitter posts containing a given company name depending of whether the post is actually related with the company or not. Five research groups submitted results for the task.
منابع مشابه
The University of Amsterdam at WePS3
In this paper we describe our participation in the Third Web People Search (WePS3) evaluation campaign. We took part in the Online Reputation Management (ORM) task. Ambiguity of organization names (e.g., “Amazon” or “Apple”) raises obvious difficulties for systems that attempt to trace mentions of and opinions about a specific company in Web data, in an unsupervised manner. Problems are further...
متن کاملOverview of RepLab 2012: Evaluating Online Reputation Management Systems
This paper summarizes the goals, organization and results of the first RepLab competitive evaluation campaign for Online Reputation Management Systems (RepLab 2012). RepLab focused on the reputation of companies, and asked participant systems to annotate different types of information on tweets containing the names of several companies. Two tasks were proposed: a profiling task, where tweets ha...
متن کاملOverview of RepLab 2014: Author Profiling and Reputation Dimensions for Online Reputation Management
This paper describes the organisation and results of RepLab 2014, the third competitive evaluation campaign for Online Reputation Management systems. This year the focus lied on two new tasks: reputation dimensions classification and author profiling, which complement the aspects of reputation analysis studied in the previous campaigns. The participants were asked (1) to classify tweets applyin...
متن کاملFiltering and Polarity Detection for Reputation Management on Tweets
In this paper we introduce our contribution to the RepLab 2013 – An evaluation campaign for Online Reputation Management Systems challenge. We participated in the filtering and polarity detection subtasks. The task of filtering is to determine whether a tweet is related to an entity. Then we classify tweets into positive, negative or neutral classes from the entity point of view. To solve these...
متن کاملCaracterización de una entidad basada en opiniones: un estudio de caso
We introduce the opinion-based entity profiling task, understood as the automatic grouping of equivalent or very similar online opinions (both positive and negative) about an entity. This is a highly practical problem that arises in the context of online reputation management, but it has not been directly addressed by any Natural Language Processing evaluation campaign or specific benchmarking ...
متن کامل